Skip to content

Conversation

@oesteban
Copy link
Member

Summary

  • add a streaming Mongo-to-Parquet migration script that emits shallow partitions and records them in a manifest
  • teach the plotting CLI to read Parquet exports so plots can be regenerated without MongoDB
  • document the migration workflow and provide a shell helper for running the plotting pipeline from Parquet data

Testing

  • python -m compileall src scripts/migrate_mongo_to_parquet.py

Codex Task

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants